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(54) Voice-controlled timing and calculating device 



(57) A voice-controlled timing and calculating 
device includes a microphone to receive a user's vocal 
signal, a voice amplifier amplifying the vocal signal, a 
comparison circuit comparing trie vocal signal with infor- 
mation stored in a memory to retrieve an associated 
instruction, a processor performing the instruction of 
serving as a time- or a calculator to generate a result 
and a voice synthesizer which converts the result from 



the processor into a synthetic voice which is then broad- 
cast by a speaker so that the device may be operated 
with vocal input and vocal output Further, the device 
may be provided with visual display to show the result of 
the processor. Also, a manually actuateaWe switch may 
be provided to allow a user to alternatively switch the 
processor between the timer and the calculator. 



10 



Voice 
Amplifier 



Memory 


^22 








Comparison 
Circuit 







■T I 




■vw- 



FIG.2 



Printed by Xerox (UK) Business Services 
2.16.7/3.6 



BNSDOCIO <EP. 



0964331A1_I_> 



1 



EP 0964 331 A1 



2 



Description 

FIELD OF THE INVENTION 

[0001] The present invention relates generally to a 
voice controlled timing and calculating device and in 
particular to a timing and calculating device which 
receives input in vocal form to perform calculation and 
timing operations and also provide output in vocal so 
that no actuation of pushbuttons of keys is needed and 
a more user-friendly environment may be obtained 
especially for the visually disabled people. 

BACKGROUND OF THE INVEMTION 

[0002] Conventional calculators or computing devices 
are usually provided with Keys or push buttons to serve 
as a user-interface, allowing the user to input the 
desired instruction and/or data. Such an arrangement is 
quite inconvenient for users who have to Key in a 
number of digits to perform a number of operations have 
to switch their eye sights between the calculator Keys 
and the list of the figures to be keyed in. Furthermore, 
such a computing device is in general not user-friendly 
to the visually disabled people. 
[0003] On the other hand, timing devices, such as 
electronic watch, is also controlled by means of push- 
buttons, especially in setting the time on the timing 
device. This is of course to some extent inconvenient for 
users, especially in a dark environment. Certainly, it is 
not user-friendly for the visually disable people. 
[0004] Thus, it is desirable to provide a voice-control- 
led timing and calculating device of which the input and 
output may be performed vocally so as to overcome the 
problems encountered in the prior art 

SUMMARY OF THE INVENTION 

[0005] Therefor, an object of the present invention is 
to provide a voice-controlled timing and calculating 
device which receives vocal inputs from a user to per- 
form the desired operation and then provides output in 
both visual and vocal forms. 

[0006] Another object of the present invention is to 
provide a voice-controlled timing and calculating device 
which allows a user to operate the device without hand 
touching the device. 

[0007] To achieve the above objects, in accordance 
with the present invention, there is provided a voice- 
controlled timing and calculating device comprising a 
microphone to receive a user's vocal signal, a voice 
amplifier amplifying the vocal signal, a comparison cir- 
cuit comparing the vocal signal with information stored 
in a memory to retrieve an associated instruction, a 
processor performing the instruction of serving as a 
timer or a calculator to generate a result, and a voice 
synthesizer which converts the result from the proces- 
sor into a synthetic voice which is then broadcast by a 



speaker so that the device may be operated with vocal 
input and vocal output Further, the device may be pro- 
vided with visual display to show the result of the proc- 
essor. Also, a manually actuateable switch may be 
5 provided to allow a user to alternatively switch the proc- 
essor between the timer and the calculator. 

BRIEF DESCRIPTION OF T HE DRAWINGS 

10 [0008] The present invention will be better understood 
from the following description of a preferred embed- 
ment thereof, with reference to the attached drawings, 
wherein: 

is Fig. 1 is a perspective view showing a voice-con- 
trolled timing and calculating device constructed in 
accordance with a preferred embodiment of the 
present invention; and 

Fig. 2 is a circuit diagram of the voice-controlled 
timing and calculating device of the present inven- 
tion. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

[0009] With reference to the drawings and in particular 
to Fig. 1 , wherein a voice-controlled timing and calculat- 
ing device constructed in accordance with the present 
invention is shown, the voice-controlled timing and cal- 
culating device of the present invention comprises a 
casing inside which a circuit (see Fig. 2), preferably in 
the form of a printed circuit board, is disposed. The cir- 
cuit performs two major tasks, calculation and timing, 
which may be manually switched by actuating switch 
SW1 provided on the casing. A second switch SW2 is 
provided to allow user to manually set the timer function 
of the circuit. 

[0010] A microphone 1 1 is provided on the casing and 
in electrical connection with the circuit for transmitting 
user's vocal instruction or input to the circuit A display 
50 is provided in connection with the circuit to visually 
display desired information, such as the result of arith- 
metic calculation operation or the current time. Also, a 
speaker 70 is provided in connection with the circuit to 
broadcast the output such as the result of arithmetic 
operation or time, of the device. 
[001 1 ] With reference to Fig. 2, the circuit of the voice- 
controlled timing and calculating device of present 
invention comprises a voice amplifier 1 0 which amplifies 
the user's vocal signal received at the microphone 11 
and provides an amplified signal to a comparison circuit 
20 which may be in the form of an IC (integrated circuit). 
The comparison IC 20 compares the amplified vocal 
signal with information stored in a memory 30 to deter- 
mine the meaning of the vocal signal and thus obtain a 
machine meaningful signal which includes instruction 
and/or data form the information stored in the memory 
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30 via address bus 21 . The machine meaningful signal 
so retrieved from the memory 30 by the comparison cir- 
cuit 20 is transferred to a processor 40 via data bus 22. 
[001 2] In accordance with a preferred embodiment of 
the present invention, a training process may be con- 
ducted at the first time when the voice-controlled timing 
and calculating device is used By performing the train- 
ing process, the user may store his or her voice in the 
memory 30 so that at the next use of the voice-control- 
ted timing and calculating device, the comparison IC 20 
may perform a correct comparison between the 
received vocal signal and the user's voice that is stored 
in the memory 30 and thus a correct operation may be 
performed. 

[0013] Alternatively, the voice information that is 
stored in the memory 30 may be built therein in advance 
by means of electronic coding process. (The electronic 
coding technique is well known and constitutes no novel 
part of the present invention so that no detail is needed 
herein.) Under this situation, no training process is 
needed 

[0014] The processor 40 that receives the machine 
meaningful signal via the data bus 22 performs the 
desired operation, such as arithmetic operation or tim- 
ing operation, instructed by the signal. The result of the 
processor 40 is output to the display 50 which may be a 
liquid crystal display and a voice synthesizer IC 60 that 
generates synthetic voice to be broadcast by the 
speaker 70 so that the operation result of the processor 
40 is displayed both visually and vocally. As mentioned 
above, the switch SW1 which performs switching opera- 
tion between the timing function and the calculating 
function of the processor 40 is connected to the proces- 
sor 40 to allow the user to manually switch between 
these two functions. The switch SW2 that allows the 
user to perform timer setting operation is also in con- 
nection with the processor 40. 
[001 5] The voice synthesizer IC 60 that converts the 
operation result of the processor 40 into synthetic voice 
is in connection with the speaker 70 via a transistor Q 
which amplifies the output of voice synthesizer IC 60 to 
provide a suitable signal to the speaker 70. 
[0016] Although in the preferred embodiment illus- 
trated in Fig. 1, the voice-controlled timing and calculat- 
ing device of the present invention is embodied in a 
rectangular casing, it is also possible to use a different 
outline of the timing and calculating device, such as a 
pen so that the pen, besides the writing function, also 
provides the functions of calculator and timer. 
[0017] The operation of the voice-controlled timing 
and calculating device is rather straightforward. For 
example, in powering on, the device checks if there is 
built-in information in the memory 30. tf there is no such 
information, then in order to properly understand the 
user's voice signal, a training process has to be con- 
ducted. The training process allows the user to store the 
instructions and data which are needed in the subse- 
quent operation of the voice-controlled tinting and cal- 



culating device in the memory 30. Those 
instructions/data may include "calculator", "timer", digits 
p-9, arithmetic operation symbols (V, ' V, V) and 
so forth. Once these instructions/data are completely 

5 stored in the memory 30, the device may then be ready 
to receive instructions from the user. 
1001 8] When the user instructs the timing and calcu- 
lating device into the timer function and actuates the 
time* setting switch SW2 to enter the timer setting 

io mode, then the display 50 Winks, showing ready to 
receive timer setting instruction. The user may then 
speaks the desired digit to the microphone 1 1 by follow- 
ing the position of a cursor on the display 50. The vocal 
signal of the digit that is received by the microphone 1 1 

75 is amplified by the voice amplifier 10 and passed to the 
comparison IC 20 and the processor 40 which in turn 
gives an instruction to show the digit on the display 50 at 
the position indicated by the cursor. The cursor is then 
moved by the processor 40 to the next position and the 

20 device is ready to receive the next digit from the user. 
Once the timer setting operation is completed, the 
device automatically goes back to the normal timing 
operation and shows the time on the display 50. 
[0019] In the normal timing operation, the user may 

25 use the switch SW1 or give a vocal instruction through 
the microphone 1 1 to switch to the calculator function in 
which the user may give calculation instruction and data 
to perform the calculation to the device via the micro- 
phone 1 1 . The comparison IC 20 provides the instruc- 

30 tion and data to the processor 40 and processor 40 
performs the operation once a calculation starting sig- 
nal is received and provides the result to the display 50 
and the voice synthesizer IC 60 so that the result may 
be displayed both visually and vocally. 

35 [0020] For example, in order to perform the arithmetic 
operation "12 x 27+195=", the user may read the digit 
and symbol in sequence so that the microphone 11 
sequentially transmits the digit and symbol to the proc- 
essor 40. Once the processor 40 receives the symbol 

40 "=", it starts the calculation operation. The equal sign n =" 
serves as the calculation starting signal in this case. 
[0021] An idle time period is pre-established so that 
when the processor 40 in the calculator function 
receives no instruction for time interval greater than the 

45 idle time period, the processor 40 automatically goes 
back to the timer function. 

[0022] Further, in order to know the time information, 
the user may directly observe the display 50 or alterna- 
tively, the user may give a vocal instruction, such as 
so "time" to the device via the microphone 11 and the proc- 
essor 40 may then control the speaker 70 to broadcast 
the current time which is synthesized in the voice syn- 
thesizer IC 60. 

[0023] The present invention provides a measure that 
55 allows two functions to be performed by a single piece 
of device. The device of the present invention provides 
not only visual display but also a vocal output so that it 
is particularly suitable for those visually disabled peo- 
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pie. Quite obviously, the idea erf using voice as input and 
output means of a device may be extended to devices of 
other functions, such as electrical appliance for example 
radio, washing machine so that a more friendly environ- 
ment especially for the visually disabled people may be 5 
established. 

[0024] Although the a preferred embodiment has been 
described to illustrate the present invention, tt is appar- 
ent that changes and modifications in the specifically 
described embodiment can be carried out without 10 
departing from the scope of the invention which is 
intended to be limited only by the appended claims. 

Claims 

15 

1. A voice-controlled timing and calculating device, 
cornprising: 

a microphone adapted to receive a vocal signal 
from a user; 20 
a voice amplifier circuit which receives the 
vocal signal from the microphone, amplifies the 
vocal signal and generates an amplified signal; 
a memory storing information of operation 
instruction and data; 25 
a comparison circuit receives the amplified sig- 
nal from the voice amplifier circuit, compares 
the amplified signal with the information stored 
in the memory to retrieve a portion of the infor- 
mation including instructions and data oorre- 30 
spending to the vocal signal from the memory; 
a processor circuit which receives said portion 
of the information including instructions and 
data from the comparison circuit and selec- 
tively performs a calculation operation and a 35 
timing operation in response to the instruction 
and based on the data of said portion of the 
information and provides an operation result; 
a voice synthesizer circuit which receives the 
operation resutt from the processor circuit and 40 
converters the operation result into synthetic 
voice; and 

a speaker for broadcasting the synthetic voice. 

2. The device as claimed in Claim 1 , further compris- 45 
ing a display which receives and visually displays 
the operation result. 

3. The device as claimed in Claim 1 , further compris- 
ing a first manually actuateabie switch in connec- so 
tion with the processor circuit to switch between the 
timing operation and the calculation operation. 

4. The device as claimed in Claim 3. further compris- 
ing a second manually actuateabie switch for inrtiat- ss 
ing a timer setting operation when the processor is 
performing timing operation. 



5. The device as claimed in Claim 1 , wherein said por- 
tion of the information comprises a switching 
instruction which instructs the processor circuit to 
switch between the timing operation and the calcu- 
lation operation. 

6. The device as claimed inClaim 5, wherein the proc- 
essor circuit has a predetermined calculator idle 
time which, where exceeded under the situation 
where the processor circuit is in the calculation 
function, swftches the processor circuit from the 
calculation function to the timing operation. 

7. A voice-controlled timing and calculating device, 
comprising: a microphone adapted to receive a 
vocal signal from a user ; 

a voice ampiffier circuit which receives the 
vocal signal from the microphone, amplifies the 
vocal signal and generates an amplified signal; 
a memory; 

means for detecting existence of information 
stored in the memory; 

means for establishing information into the 
memory in response to and based on the 
reception of vocal signal from a user when no 
existence of information is detected in the 
memory; 

a comparison circuit receives the amplified sig- 
nal from the voice amplifier circuit compares 
the amplified signal with the information stored 
in the memory to retrieve a portion of the infor- 
mation including instructions and data corre- 
sponding to the vocal signal from the memory; 
a processor circuit which receives said portion 
of the information including instructions and 
data from the comparison circuit and selec- 
tively performs a calculation operation and a 
timing operation in response to the instruction 
and based on the data of said portion of the 
information and provides an operation result; 
a voice synthesizer circuit which receives the 
operation result from the processor circuit and 
converters the operation result into synthetic 
voice; and 

a speaker for broadcasting the synthetic voice. 

8. A method for vocally setting a timer which com- 
prises a display having a plurality of digits including 
to display an old time controlled by a processing cir- 
cuit to a new time, the processing circuit comprising 
a vocal signal receiving means which receives an 
external vocal signal and converts the vocal signal 
into an electronic signal including an timer setting 
instruction and numeric digits to the processing cir- 
cuit the timer setting instruction switching the 
processing circuit between a time display mode in 
which the display shows the time and a timer setting 
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mode, ths method comprising the steps of: 

(a) receiving a vocal signal of the timer setting 
instruction by means of the vocal signal receiv- 
ing means to switch the circuit from the time s 
display mode to the timer setting mode ; 

(b) the processing circuit indicating ready at a 
first digit of the old time; 

(c) receiving a numeric digit of the new time by 
means of the vocal signal receiving means and 10 
replacing a corresponding digit of the old time 
with said numeric digit of the new time which is 
vocally received; 

(d) the processing circuit moving to a next digit 

of the old time and repeating step (c) until the 15 
processing circuit reaches a last digit of the old 
time; and 

(e) the processing circuit resuming the time dis- 
play mode. 

20 

9. The method as claimed in Claim 8, wherein the 
vocal signal receiving means comprises a micro- 
phone adapted to receive a vocal signal from a user 
and a converting circuit to convert the vocal signal 

to the electronic signal to the processing circuit 25 

10. Themethod as claimed in Claim8, wherein the indi- 
cating step (b) comprises blinking the digit 

11. The method as claimed in Claim 8, wherein the 30 
timer comprises a speaker in connection with the 
processing circuit and wherein the indicating step 

(b) comprises vocally indicates, by means of the 
speaker, that the processing circuit is at the digit. 

35 

12. A method for vocally operating a calculator which 
comprises vocal signal receiving means adapted to 
receive vocal signals from a user, a processing cir- 
cuit for performing calculation operation instructed 

by the user's vocal signals and an output means to 40 
provide a result of the calculation to the user, the 
■method comprising the steps of: 

(a) providing a vocal signal representing a for- 
mula to be calculated to the calculator by 45 
means of the vocal signal receiving means to 
enter the formula to be calculated into the cal- 
culator; 

(b) vocally provicfing a start calculation signal to 
the calculator via the vocal signal receiving so 
means to initiate the processing circuit to per- 
form the calculation of the formula and obtain a 
result; and 

(c) the processing circuit reporting the result 

via the output means. 55 

13. The method as claimed in Claim 12, wherein the 
step (a) of providing the vocal signal to the calcula- 



tor further comprises the steps (1) of vocally provid- 
ing a confirm request signal to the calculator to 
have the processing circuit confirm the formula by 
means of the output means and (2) selectively 
vocally providing a correction request signal to the 
calculator to have the calculator correct the entered 
formula in accordance with a vocal signal of a new 
formula to be calculated provided following the cor- 
rection request signal 

14. The method as claimed in Claim 12, wherein the 
vocal signal receiving means comprises a micro- 
phone adapted to receive the vocal signal from the 
user and a converting circuit to convert the vocal 
signal to the electronic signal to the processing cir- 
cuit. 

15. The method as claimed in Claim 12, wherein the 
output means comprises a visual display device in 
connection with the processing circuit. 

16. the method as claimed in Claim 13, wherein the 
output means comprises a voice synthesizer in 
connection with the processing circuit and a 
speaker connected thereto. 



BNSDOCID: <EP 0964331 A 1_t_> 



EP 0964 331 A1 




BNSDOCID: <EP 0964331A1_I_> 



EP 0 964 331 A1 




* 

EP 0 964 331 A1 



European Patent 



EUROPEAN SEARCH REPORT 



EP 98 30 4510 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citato, ol document with indication, where appropriate, 
or relevant passaoes 



Rate want 
to ctann 



CLASSIFICATION OF TKE 
APPLICATION nnLOO 



EP 0 212 759 A (LELY NV C VAN DER) 
4 March 1987 

* column 2, line 3 - column 3, line 9 * 

* column 4, line 12 - line 37 * 

* column 5. line 1 ^ line 7 * 

* column 6, line 5-11; figures 1,7,8 * 



GB 2 255 425 A (CHAN MING KUN) 
4 November 1992 

* the whole document * 

"CALCULATOR FOR THE VISUALLY IMPAIRED" 
IBM TECHNICAL DISCLOSURE BULLETIN, 
vol. 37, no. 1, 1 January 1994, page 141 
XP000428723 

* page 141, paragraph 2 - page 141, 
paragraph 3 * 

US 4 635 286 A (BUI NGOC C ET AL) 
6 January 1987 

* column 3, line 1 - column 4, line 2 * 

* column 18, line 35 - column 28, line 32; 
figures 1,10,11 * 

"ANNOUNCEMENT" 
SPEECH TECHNOLOGY , MAN-MACHINE VOICE 
COMMUNICATIONS, 

vol. 4, no. 3, 1 September 1988, pages 
90-93, XP0001 10770 

* page 91, left-hand column, paragraph 1 - 
right-hand column, paragraph 4 * 

DE 297 13 054 U (IMPEX HANDELSGESELLSCHAFT 
MBH) 6 November 1997 

* page 3, line 15 - page 6, line 16 * 



1-7,12, 
14,15 



8-11,13, 
16 

1-7,12, 

14,15 

11,16 

12-16 



1,7 

8-11 

1,7 

12-16 
1,7 

1,7-11 



The present search report has been. drawn up tor all dams 



G06F3/16 
G04G1/00 



TECHNICAL FIELDS 
SEARCHED (tW.Cl.6) 



G06F 

G04G 
G10L 



THE HAGUE 



24 November 1998 



Moens, R 



CATEGORY OF CITED OOCUUENTS 

X parttaAarty relewnt i tefcan atone 
Y . partioiaiV ntovxrA i con*»nod*rth Another 
(tocuBWU of the same cttooofy 

A. tm l IimiiIhoI mmi I Iji —M 

O " 

p 



T theory or pnncple inaeoyngthe 
E earfeor patent docu 
•fttrthelHngdrte 
O documoftt ortod m the 



& - member oi thas 



a patent fuxufy, corrospandjnQ 



8 



BNSDOCID: <EP 0984331A1 J_> 



EP 0 964 331 A1 



ANNEX TO THE EUROPEAN SEARCH REPORT 
ON EUROPEAN PATENT APPLICATION NO. 



EP 98 30 4510 



This annex tets the patent tamly memberereteting to the patent documents ated m the above-mentioned European search report 
The members are as contorted tn the European Paieot Office EDP We on 

The European Patent Office is in no way Sable tor these particulars which ere merely g**>n for the purpose of irrformatron. 

24-11-1998 



Patent document 




KUOoCoBOn 


F 


*atent tarrtoy 


Publication 


cited m search re per 




date 




members) 




EP 0212759 


A 


04-03-1987 


NL 


8502959 A 


16-03-1987 








US 


4882685 A 


21-11-1989 


GB 2255425 


A 


04-11-1992 


NONE 






US 4635286 


A 


06-01-1900 


CH 


645501 A 


15-10-1984 








DE 


3226842 A 


10-02-1983 








DE 


3226929 A 


10-02-1983 








FR 


2510277 A 


28-01-1983 








FR 


2510795 A 


04-02-1983 








JP 


58026291 A 


16-02-1983 








JP 


58025700 A 


15-02-1983 








US 


4573187 A 


25-02-1986 


DE 29713054 


U 


06-11-1997 


NONE 







i For mora details about ms annex - sea Official Journal ol the European Patent Office. Mo. 12/82 



BNSDOCID: <EP 0964331A1_I_> 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 



Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 



□ FADED TEXT OR DRAWING 
oTblurred OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

Qf^REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: . 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



BEST AVAILABLE IMAGES 




